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Abstract 

We consider a stochastic control problem, where the control do- 
main is convex and the system is governed by a nonlinear backward 
stochastic differential equation. With a terminal data, we derive 
necessary optimality conditions in the form of stochastic maximum 
principle. 
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1 Introduction 



We consider a stochastic control problem where the control domain is convex 
and the system is governed by a backward stochastic differential equation 
(BSDE for short) of the type 

r dy^ = b{t,ylz^,Vt)dt + z^dWt, 
*This work is partially supported by Algerian-French cooperation, Tassili 07 MDU 705. 
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where W = {Wt)^^^ is a standard Brownian motion, defined on a filtered 
probability space (^2, JF, {J-'t)^^^ , V) , satisfying the usual conditions. The 
control variable v is an .Fj-adapted process with values in a convex closed 
subset U of R"*. The terminal condition ^ is a n-dimensional ^^-measurable 
random vector such that E |,^| < oo. 

The objective of the control problem, is to choose u in such a way as to 
minimize a functional cost of the type 



J{v) = E 



9{yo)+ rh{t,ylzlvt)dt 
Jo 



A control process that solves this problem is called optimal. 

Stochastic control problems for the backward and forward-backward sys- 
tems have been studied by many authors including Peng [21], Xu [24], El- 
Karoui et al [12], Wu [23], Dokuchaev and Zhou [9], Peng and Wu [22], 
Bahlali and Labed [1], Bahlali [2, 3]. Approachs based on dynamic program- 
ming have been studied by Fuhrman and Tessetore [14]. All this papers 
consider BSDEs with terminal condition, p > 2. 

The aim of the present paper is to derive necessary optimality conditions, 
in the form of stochastic maximum principle. The terminal condition is 
assumed in L^. This is the first version which covers the control of backward 
systems in L^. Our result extend all the previous works in the subject. 

Since the control domain is convex, a classical way of treating such a 
problem consists to use the convex perturbation method. More precisely, if 
u is an optimal control and v is arbitrary, we define, for each t E [0,T], a. 
perturbed control as follows 



u 



With a sufficiently small ^ > 0, we derive the variational equation from 
the fact that 

< J -J{u). 

The paper is organized as follows. In Section 2, we formulate the problem 
and give the various assumptions used throughout the paper. Section 3 is 
devoted to some preliminary results, which will be used in the sequel. In the 
last Section, we derive our main result, the necessary optimality conditions. 



Along this paper, we denote by C some positive constant and for sim- 
plicity, we need the following matrix notation. We denote by Ainxd {^) 
the space of n x ci real matrix and A^f^xn (^) the linear space of vectors 
M = (Ml, Mrf) where E Mnxn W- 
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For any M,N e M^^^ (M), L,S e Mnxd (K), a, /3 G M" and 7 G we 
use the following notations 

n 

af3 — ^^ctj/^i e R is the product scalar in M", 

d 

LS = ^^I/jS'j e M, where and are the i^^ columns of L and S, 

1=1 

d 

ML = ^MiLi e R", 

i=l 
i=l 

1=1 

d 

MLN ^ ^M,L7V, e A1„xn (M), 

d 

We denote by L* the transpose of the matrix L and M* = (Mj", MJ). 



2 Formulation of the problem 

Let T be a fixed strictly positive real number and (^,J^, {^t)te[0T] 
a filtered probability space satisfying the usual conditions, on which a d- 
dimensional Brownian motion W = (W^t)tg[or] defined. We assume that 
(•^t)te[0T] ^~ augmentation of the natural filtration of (M/t)te[oT]- 

Definition 1 Let U be a closed convex subset o/R™. An admissible control 
V is an Tt- (adapted process with values in U such that 

2 

sup ^\vt\ < 00. 
te[o,T] 

We denote by lA the set of all admissible controls. 

For any v &U, we consider the following controlled BSDE 



dy^^bit,ylz^,Vt)dt + z^dWt, 
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where b : [0, T] x M" x Mnxd (K) x U — ^ M" and ^ is an n-dimensional Tt- 
measurable random vector such that E |^| < oo. 

The aim of the control problem is to minimize, over the class U of admis- 
sible controls, a functional cost of the form 



J{v)=E 



T 



9{yo)+ / h{t,ylzlvt)dt , 

where g:W — > M and /i : [0, T] x M'^ x Mnxd {^) x U — > R. 
A control u eU is called optimal, if that solves the problem 

J{u) = miJ{v). 



(2) 



(3) 



Our goal in this paper is to establish necessary optimality conditions, in 
the form of stochastic maximum principle. 

To study this kind of problem, we need reasonable conditions which en- 
sure the existence and uniqueness of solutions of BSDEs with terminal 
condition. This is given by the results of Briand et al [5, page 124-128]. 

Miming [5], we use the following notations. 

Let us denote by Y^j, the set of all stopping times r such that t <T. A 
process Y = {yt)te[oT] belongs to class {D) , if the family {1^, t G StI 
uniformly integrable. 

For a process Y in class (D), we put 



= sup {E\Yr\, T e 



The space of progressively measurable continuous processes which be- 
long to class (D) is complete under this norm, see Dellacherie and Meyer 
[7, page 90] . 

For any real p > 0, = (M") denotes the set of E"- valued, adapted 
cadlag processes {^t}tg[or] ^^^^ that 



\X\ 



SP 



E 



sup \Xt\ 



lAl/p 



< +00. 



If p > 1, \\.\\gp is a norm on 5'*' and if p G (0, 1), (X, X'^ i- 
defines a distance on S^. Under this metric, is complete. 



\X-X 



\sp 
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MP = MP (W"-) denotes the set of (equivalent classes of) predictable pro- 
cesses {-'^tltejoT] "^^^ values in M" such that 



I^IImp — ^ 



p/2- 



lAl/p 



< +00. 



For p > 1, MP is a Banach space endowed with this norm and for p G 
(0, 1), MP is a complete metric space with the resulting distance. 

We assume, 

(4.1) b, g, h are continuously differentiable with respect to (y, z, v) . 

(4.2) The derivatives by, b^, b^, hy, hz, and gy are continuous 
in {y, z, v) and uniformly bounded. 

(4.3) g is bounded by C (1 + \y\) . 

(4.4) Vr > 0, we have (for f = b,h) 

(j)r (t) := snp\f{t,y,0,v)-f{t,0,0,v)\eL'i[0,T]xQ,m^V). 

\y\<r 

(4.5) There exists two constants C > 0, a G (0, 1) and a non-negative 
progressively measurable processes {^t}t&[oT] {^t}te[or] 
such that V (t, y, z, v) G [0, T] x x Mnxd (M) x U, 

\f {t, y, z,v)-f {t, y,0,v)\<C {cpt + \y\ + \z\ + \v\r , for / = b, h. 



E 



< +00. 



(4.6) V {t, y, zi,v), {t, y, Z2, v) G [0, T] x R" x Mnxd 
\f {t, y, zi, v)- f {t, y, Z2, v)\ < C \zi - Z2\ , 
for / = by, bz, b^, hy, h^, K- 



X U, 



(4) 

The above assumptions imply those of Briand et al [5]. Hence from 
[5, Th 6.2, p 125 and Th 6.3, p 126], for every v & U, equation (1) admits 
a unique adapted solution. 

We note that for the uniqueness, the solution y belongs to the class (D) 
and z belongs to the space M^, a G (0,1). For the existence, the 

solution y belongs to the class (D) and for each /3 G (0, 1), {y, z) belongs to 
the space Sl^ x M^^ . 

More details are given in Briand et al [5, page 124-128]. 

To enclose the formulation of the problem, it remains us to prove that 
the cost J is well defined. This is given by the following lemma. 



Lemma 2 The functional cost J is well defined from U into 



5 



Proof. Consider the following controlled one dimensional BSDE 



dxl = h {t, y^, z^, vt) dt + k^dW^ 



where k'" — {kl,...,k'^) is an (1 x d) real matrix, {y'",z'") is the solution of 
equation (1) and 77 is a one dimensional .Tr-measurable random variable such 
that E < 00. 

Under assumptions (4), the above one dimensional BSDE admits a unique 
adapted solution {x^ , k^). 
We put 



y 



X 



and consider now the following {n + l)-dimensional BSDE 



dyt = b {t, yt, Zt, Vt) dt + ZtdWt, 



yr 



where the function b is defined from [0,r] x M"+^ x M.{n+i)xd 
by 

7,^ , / b(t,yl',z^,vt) 

and z is a {n + 1) X d real matrix given by 

^11 ^12 ••• ^Id 



X U into 



z" 



''21 ^22 



^nl ^n2 



■^2d 



-nd 



It's obvious that b satisfies hypothesis (4), then the above {n + l)-dimensional 
BSDE admits a unique adapted solution {yt,Zt). 
Define now the function g from R"+^ into R by 

9{yt)^9{yl)-xl 

and the new functional cost from U into R by 

J{v)^E[g{yo)]+E[r)]. 
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It's easy to see that for every v eU 

J{v) = J{v). 

By (4.3) the cost J is well defined from U into R and since J (v) — J (v), 
for every v eU, the cost J is well defined from 14 into M. 
The proof is completed. ■ 

Let us now state and prove an alternative result that we will be used 
along this paper. This result said that the difference betwen two solutions of 
BSDEs with the same terminal condition in is a solution of BSDE in L^, 
and it is given by the following lemma. 

Lemma 3 Let {y^,z^) and {y^,z^) be the solutions of (1) associated respec- 
tively with the controls v and w. Then the following BSDE 

d {yl - yr) = [h {t, yl z^Vt) - b {t, y^, z^, Wt)] dt + {z^ - z^) dWt, 

Vt ~yT = ^: 

admits a unique adapted solution {y'" — y"^, z'" — z^) such that 

fT 

supE\y-,-y]^f + E \z^^ - z]^\' dt < +oo. (5) 
te[o,T] Jo 

Proof. We have 

yt - yr = -^^ [b is, yl, z^, v,) - b {s, yf, zf, Ws)] ds - {zl - z^) dWs. 
Then 

Vt - yr 

= -[ {s, yf + A {y: - yf) ,zr + X (z^ - zf) ,w, + X{v,- w,)) dX^ {yl - y:) ds 

- y^ + A {yl - y^) , < + A [z^ - z^) ,Ws + X{v,- w^)) dX^ {zl - ds 

- (s, yr + A {yl - yr) , + A {zl - z^) ,w, + X{v,- w^)) dX^ [v^ - w^) ds 

(z: - z:) dWs. 

The above equation is a hnear BSDE. Since by,bz,by are bounded, the 
terminal condition y^ — y^ = and the controls are in L^, then by a classical 
result on BSDEs (see Pardoux-Peng [19], El Karoui et al [12]), we have the 
desired results. ■ 
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3 Preliminary results 



Since the control domain U is convex, the classical way consists to use the 
convex perturbation method. More precisely, let u be an optimal control 
minimizing the cost J over U and (y", z^) the solution of (1) controlled by 
u. Define a perturbed control as follows 

+ 9 {vt - Ut) , 

where ^ > is sufficiently small and v is an arbitrary element of U. 
It's clear that is an element of U (admissible control). 
Denote by (yf , z^) the solution of (1) associated with u^. 

Since u is optimal, the variational inequality follows from the fact that 

< J {u^) -J{u). 
This is can be proved by using the following lemmas. 
Lemma 4 Under assumptions (4), we have 



^te[o,T] 

Proof. By (5), we have 



I j^^ \zt - z^\' dt^ 



hm I sup E \yl - + E / \zt -z'lYdt\^Q. (6) 



pT 

sup E \yl - y^f + E / \zf - z^\^ dt < +oo. 

tG[0,Tl Jo 

Applying the Ito formula to (i/f — yt)"^, we get 









^ ds 








= 2E 




ivt-y:) {b{s,yt, 


zl<) 


-b(s,y:, 




Us))\ ds 


< 2E 




ivt-y:) {b{s,yt, 


zlul) 


-b{s,yl. 




,<)) \ ds 


+ 2E 





(yt-y:) {b{s,y:, 


z:,ui) 


-b{s,y^, 




Us))\ ds. 
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Applying the Young's formula to the first term in the right hand side of 
the above inequality, we have for every e > 

E\y',-y^f + El^^\4-z^\'ds 

< Je^^ \yt -y^fds + e^j^ \h {s, yl zl u^) - b {s, y^, z^, u^) f ds 

+ 2E^^ I {y', - y^) {b {s, yl z^, u^) - b (s, yl z^, | ds. 
By (4.2), b is uniformly Lipschitz with respect {y,z,v). Then 
E\yl-y-\^-rEj'^ \zl-z^,\Us 



T i-T 



<\^^ + Cej J E ly"^ - y^f ds + CeJ E [z^ - z^\^ ds 

+ Cej\[\y',-y:\\vs-Us\] ds. 

Applying the Cauchy-Schwarz inequality to the third term in the right 
hand side of the above inequality, we get 

E\y',-y^\' + Er\zt-z^\'ds 



T i-T 
2 



<[1. + Ce] I E\yl-y^^\ ds + Cej E - ds 



,T \ 1/2 / \ 1/2 

+ Ce[ I EW^-y'^fds] ( / E\vs-Us\2ds] 



Using definition 1 and (6), we have 

E\yl-y^,f + Ej^\zl-z':\'ds 



<[- + Cej J E \yl - y^\ ds + Ce j E {z^ - z^\ ds 

I-T 

+ Cel E\z^, - z:\^ ds + C0. 



Choose e = then we get 



E |yf - 2/rr + l^J^^ \z! -z^\'ds< (^2C + ^"^E -y:\'ds + C9. 



From this above inequality, we deduce two inequalities 

E \yt - < [2c + j\ \yl - i/rf + Ce. 

E r \< - r < (4C + 1) - y^S ds + C^. 



-'t Jt 
By (7), Gronwall lemma and Buckholers-Davis-Gundy inequality, we 



linil sup E|yf-y,"l' 
^0 V*e[o.^] 



0. 



Finally, by (8) and the above result, we obtain 

i-T 

limE/ U^-^"|^ds = 0. 

The lemma is proved. ■ 
Lemma 5 For every v gU, the following linear BSDE 

dYt = [by {t, y^, ut) Yt + (t, z^, ut) Zt] dt 

by {t, y^, z^, Ut) {vt - Ut) dt + ZtdWt, 
Yt= 0, 

admits a unique adapted solution {Y, Z) such that 

E|yt|^ + E / 

tG[0,T] 



supE|yt|^ + E/ \Ztfdt< 00. 



lim I E 



Y 



Vt - Vt 
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+ E 



T 



9 



dt\ =Q. 



Proof, i) Assertion (10) is obvious since the BSDE (9) is linear, by, 
are bounded and the terminal condition 1^ = 0. 
ii) Let us prove (11). 



Put 



^Y- 



9 ' 

~6 yU 

^t-Zt-'-^. 
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We have 

d^t = [B'y it) + Bl (t) + pt] dt + <iftdWt, 

where 

B'y (t) = [\y {t, + X {yt - y^) ,z^ + \ {zf - z^) ,Ut + Xe {vt - Ut)) dX, 
Jo 

Bl (t) = / 6, {t, yr + A {yf - y^) ,z^ + X {zf - z^) ,m + Xe {vt - m)) dX, 
Jo 

/ [by{t,y^ + X{y',-y^),z^ + X{zt-z^),Ut + Xe{vt-Ut)) 
Jo 

-byit,y^,z^,Ut)]YtdX 

+ f [b, {t, y^ + A {vt - vt) ,z^ + X {zl - z^) ,Ut + Xe {vt - Ut)) 
Jo 

-b, {t,ylzr,Ut)]ZtdX 

+ [ [b, {t, y^ + A (yf - , + A {zf - z^) ,Ut + Xe (vt - Ut)) 
Jo 

-b^{t,y'^,z^,ut)] {ut-vt) dX. 
By (5) and (10), it is easy to see that 



E|$^r + E/ \^^fdt<+oo. (12) 



Applying the Ito formula to (^t)^, we get 

E\^t\' + Ej^^\^l\'ds< 2E^^ 1$^ {Bl is) $^ + Bl (s) + p^) \ ds. 

By the Young's formula and using the fact that By and B^. are bounded, 
we have for every £ > 

E|$^f+Ej^ \^lfds<(^^ + Ce^Ej^ ds+CeEjl" | f (is+CeE \plf ds. 

Choose e = then we get 

2(_y 



1. 



r-T 



E|<l>,"| +-E/ l^^l ds < (2C + -]E I |$^| ds + -El \pl\ ds. 
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From this above inequality, we deduce two inequalities 



E|$?f < (^2C+0E^ \<^l\^ds + ]fj^ \pl\'ds. (13) 

E |*^|'ds< (4C+1)e/ \^l\'ds + E Iptl^ds. (14) 
Jt Jt Jt 



Let us prove now that hmE / Ipf I ds — 0. 
We have 



E 



I \pt\ds<E[ I \hy{s,y-^+X{yl-y-),z': + X{zl-z'^),Us + \e{vs- 
Jt Jt Jo 

- by {s, + A {yt - y:) , z^, Us + {v^ - «.)) | Y^dMs 

+ e/ / + A (yf-y:),z^u, + A^ (!;,-«,)) 

Jt Jo 

- by{s,y^,z^,Us)\Y,dXds 

+ E /' 1 6, (s, y: + A (yf - y^) , z^ + X (zf - z^) ,u, + Xe {v, - 
Jt Jo 

- {s, + X (yf - y«) , z^, + Xd {v^ - Us)) \ ZJXds 

+ I \b. {s, y: + A (yf - yr) , Us + Xe {vs - «.)) 

- {s,y^,z^,Us)\Zsds 

+ Ef f\h, (s, y: + A (yf - y^) , z," + A (zf - z^) ,u, + Xe {v, - 
Jt Jo 

- by (s, y^ + A (yf - y^) , Us + A^ (v, - Us)) \ {us - Vs) dXds 

+ e[ f\by (s, y: + A {yl - y:) , z^, Us + A^ (^;, - Us)) 
Jt Jo 

- by (s, y", Us) I (us - t^s) dXds. 
Applying the Cauchy-Schwarz inequality, then by using (4.6) and (10), 
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we get 

e[ \pl\ds<C(El \zl-z^rds] +C(E/ Iz^.-z^rds 



T sl/2.T ^ \ 1/2 



+ c(eJ^ J^\by {s, y: + A {yt - y^) , z^, + Xd {v^ - u,)) 

- b,{s,y:,z^,u,)fdXdsY^' (15) 
+ c(eJ^ J^\b, {s, y^ + A (i/f - y^) , z^ + A^ {v^ - 

- b,{s,y':,z':,Us)U\dsf^^ 

+ c(eJ^ |6, {s, y: + A {yl - y^) , z^, + A^ {v^ - 

- by{s,y^,z^,Us)f dXdsY^^ . 

By (6), the first and second terms in the right hand side of the above 
inequahty tends to as ^ go to 0. 

On the other hand, since by, b^ and by are continuous and bounded, then 
from (6) and the dominated convergence theorem, we show that the third, 
fourth and fifth terms in the right hand side tends to as 6* go to 0. 

Then, we get 

hmE/ \p^Ads = 0. 

Moreover, from (15), (5) and the fact that by, bz and by are bounded, we 
show that 

E \pI\ ds < +00. 
Using the dominated convergence theorem, we have 

rT 

hmE/ \p^fds = 0. 
By (13) and Gronwall lemma, we deduce that 



6>-*0 

Finally, by (14) we have 



limE|$jf = 0. 



/•T 

limE / l^ffdt^O. 
Jo ' ' 



Lemma 5 is proved. 
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Lemma 6 Let u he an optimal control minimizing the cost J over U and 
{y^, z^) the solution of (1) controlled by u. Then for any v &U, we have 

0<E[gy{y^)Yo]+E[ hy {t,yf, zlut)Ytdt (16) 

+ e[ K{t,ylzlut)Ztdt + E [ h,{t,y^,z^,ut){vt-ut)dt. 
Jo Jo 

Proof. We use the same notations that in lemma 5 for and . 
Since u is optimal, we have 

< J {u^) - J (u) 

<E[g {y',) - g {y^)] +E T [h {t, yl zl u^) - h {t, z^, dt 

Jo 

< ^l\y {vo + A W - y'o)) (^^) ^A 



+ eJ^ j^hy {t, y^ + A {yt - y^) , z^ + X (^f - z^) ,Ut + Xe {v^ - Ut)) (^1—11^ dXdt 
+ ^J^l'h. {t, + A {yl - yt) , 4' + A {z\ - z't) .Ut + Xd {yt - m)) {^—Q^ dXdt 

+ e[ [hit, y^ + X {yt - y^) .z^ + X (zf - z^) ,Ut + Xe {vt - m)) {vt - m) dXdt. 
Jo Jo 



Then 



< E (y^) Yol+El ^hy {t, yl z^ m) Ytdt 



+ e[ Kit,ylzlut)Ztdt (17) 
Jo 

+ e[ K (t, y^ z^ ut) (vt - ut) dt + 61 
Jo 
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where 5^ is given by 

5t = E [{gy (yo" + A {yl - y^)) - gy (?/«)) Fq] - E f gy (|/« + A {yl - y^)) ^',d\ 

Jo 

-e[ [ hy{t,yr + X{yt-y^),z^ + X{4-z^),Ut + Xe(vt-Ut))^td^dt 
Jo Jo 

+ E /' [hy {t, yr + A {yf - y^) , + A {zf - z^) ,Ut + Xe {v^ - m)) 
Jo Jo 

- hy {t,y^,z^,Ut)]YtdXdt 

-eT Ck {t, z/r + A {yf - yr) , + A (^f - ^r) ,^t+\o {v, - «o) ^^tdxdt 

Jo Jo 

+ e/ / [h^(t,y^ + X{y',-y^),z^ + X{zt-z^),u, + X9{v,-Ut)) 
Jo Jo 

- K {t,y:t,zlut)]ZtdXdt 

+ E / [K {t, y: + A {yt - y^) ,z^ + X [zl - z^) ,ut + X9 {vt - ut)) 
Jo 

- hy {t, y", z^, Ut)] {vt - Ut) dXdt. 



Let us show that limS? = 0. 

e-*o ^ 
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We have 



5t = E [{gy {y-, + A {yl - t/^^)) - g, (y^')) >^o] - E \\y {yl + A {yl - y^)) $^dA. 

- E / I h^{t, y\ + A {yl - y^^) , z," + A (^f - z,") , + A^ {v, - u,)) ^fdXdt 
Jo Jo 

+ e/ / [hy[t,y^ + X{yt-yt),z^ + X{4-z^),Ut + Xe(vt-Ut)) 
Jo Jo 

- hy {t, y\ + A [yl - yt) , «t + A^ {v^ - Ut))\ YtdXdt 

+ e[ I [hy {t, y^ + X {yl - y^) , z^, Ut + XO {vt - Ut)) - hy {t, y^, z^ Ut)] Y^dXdt 
Jo Jo 

-eT fh, {t, y^ + A {y', - y^) ,z^ + X {z^ - z^) .Ut + XO {vt - Ut)) ^>ldXdt 
Jo Jo 

+ Ef f [K {t, yX + A [yl - y^) , + A {zl - zX) ,u,-rXd {v, - u^)) 
Jo Jo 

- K {t, y^ + X {yf - y^) , z^, Ut + Xe {vt - Ut))] Z^dXdt 

+ e[ [ [h, {t, yX + A [yl - y^) , z^ + A^ {v^ - Ut)) - K {t, y^, z^^, u^)] Z^dXdt 
Jo Jo 

+ e[ f [K {t, + A {y't - Vt) , < + A {zl - z^) , + A^ {v^ - ut)) 
Jo Jo 

- K {t, y^ + X {yl - y^) , z^, Ut + X9 {vt - Ut))] {vt - Ut) dXdt 

+ e[ [ [K{t,yX + X{y',-yr),zr,Ut + Xe(vt-Ut)) 
Jo Jo 

- K it, Vt: 4-, (^t - «t) ^Adt 

Applying the Cauchy-Schwarz inequahty, then by using (10) , (4.6) , def- 



16 



inition 1 and the fact that gy,hy, hz are bounded, we get 

1/2 f r'^ \ / r'^ ^ 

l^i'l < C(E|$^f j +C[^J l^'tl^dt] +c(e/ 1^,1' (it 

+ c(^^^E|z,^-^,"fcit) ^ +c(E|^,(y« + A(yo'-yo))-5.(?/o)r)'^' 
+ cUr f \hy (t, + A (y,^ - y'l) , z^, ut + A^ {vt - ut)) 



^0 

1/2 



- /i^(t,yr,z^«t)r^^Adt) 



^0 



- h,{t,y'^,z'i,ut)fd\dtf'^ 



+ c(eJ^ J^\K {t, y1 + A {yl - y,") , «t + A^ {vt - ut)) 

- Kit,y^,z^,Ut)fdXdtY^\ 

By (6) and (11), the first, second, third and fourth terms in the right 
hand side of the above inequahty tend to as ^ go to 0. 

On the other hand, since Qy, hy, and hy are continous and bounded, 

then by (6) and the dominated convergence theorem, the fifth, sixth, seventh 

and eighth terms in the right hand side tend to as ^ to 0. 

Consequently, limS^ = and by letting 6 go to in (17), the proof is 
— ^0 

completed. ■ 



4 Necessary optimality conditions 

Starting from the variational inequality (16), we can now stated and prove 
our main result in thnis paper, the necessary optimality conditions. 

Theorem 7 (Necessary optimality conditions). Let {u,y^,z^) be an optimal 
solution of the control problem {(1) , (2) , (3)}. Then, there exists a unique 
adapted process 

p"GL^([0,T];M"), 

which is solution of the following forward stochastic differential equation 
(called adjoint equation) 

r -dp" = Hy it, y^, z^, Ut, p'i) dt + {t, y^, z^, Ut, p'i) dWt, , . 
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such that for every v 

Hv {t, Vt, ut,p'i) {ut -vt)>0 , as , ae, 



(19) 



where the Hamiltonian H is defined from [0, T] x R" x Mnxd (K) x ?7 x R" 
into R by 

H{t,y,z,v,p) ^pb{t,y,z,v) -h{t,y,z,v). 
Proof. Since Pq = Qy {y^), then by the variational inequahty (16), we have 

< E [p«Fo] hy {t, yl z^, Ut) Y,dt (20) 

+ e[ h,{t,y^,z^,Ut)Ztdt + E [ h,{t,ylz^,ut){vt-ut)dt. 
Jo Jo 

where (y, Z) is the sohition of (9). 

Applying the Ito formula to p^Yt, we get 

E\p^Yo] = -e[ hy{t,ylzlut)Ytdt-E[ p^b, {t,y^, zt,Ut) {vt - Ut) dt 
Jo Jo 

-e[ h,{t,y^,z:t,u,)Z,dt + E[ST]. 
Jo 

where St is given by 



St^ / [H,{t,ylz^,Ut,p'^)Y -p^Zt]dWt. 
Jo 

By replaces E [pqYq] by it's value in (20), we have 

< E / H,{t, y,", z^ Ut) {ut - vt) dt + E [St] . 
Jo 



(21) 



The adjoint equation (18) is a linear forward stochastic differential equa- 
tion with bounded coefficients and bounded initial condition, then it admits 
a unique adapted solution p^ such that 



E 



sup \Pt\ 
te[o,T] 



< +00. 



(22) 



By the Cauchy-Schwarz inequality, and using (10), (22), the fact that b^, 
hz are bounded and the dominated convergence theorem, we show that S is 
a L^-martingale. 

Hence, E [St] = and the result follows immediately from (21) . ■ 
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